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ABSTRACT 

The  purpose  of  this  paper  is  to  develop  simple  algorithms  and 
flow  charts  for  the  homotopy  continuation  methods  so  that  scientists 
may  easily  program  reliable  curve  followers.  The  emphasis  is  on 
simplicity  and  reliability  at  the  expense  of  the  speed. 
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SIGNIFICANCE  ANP  EXPLANATION 


The  essence  of  the  "continuation  method"  is  "path  following". 


The  i  moose  of  this  paper  is  to  develop  simple  algorithms  and  flow 
charts  so  that  scientists  may  easily  program  reliable  curve 
fol lowers . 
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A  SIMPLE  RELIABLE  NUMERICAL  ALGORITHM 
FOR  FOLLOWING  HOMOTOPY  PATHS 


Tien-Yien  Li^'^  and  James  A.  Yorke  '  2  ^  ^  * 


41.  Introduction 

Newton's  method  has  orobably  long  been  the  most  fre¬ 
quently  used  method  for  solving  systems  of  nonlinear  eaua- 
tions  but  it  is  most  useful  when  an  aoproximate  solution  is 
available.  With  the  recent  work  of  Scarf  [111,  Eaves  [7]  , 
Saigal  (6]  and  others,  powerful  new  technicrues  have  become 
available  for  the  solution  of  systems  of  nonlinear  enuations. 
Their  approach  is  based  on  simplicial  decompositions  of  spaces 
involved  and  the  following  of  a  piecewise  linear  path  to  the 
solution.  Kellogg,  Li  and  Yorke  [10],  followed  by  Smale  [12], 
and  Chow,  Mai let-Paret ,  and  Yorke  [3]  found  a  related  approach 
for  systems  of  smooth  (differentiable)  systems  in  which  the 
piecewise  linear  path  was  replaced  by  a  smooth  curve.  In 
this  approach  simplicial  decomposition  and  pivoting  methods 
are  replaced  by  curve  following  techniaues  which  are  based  on 
highly  developed  nonlinear  analysis  techniaues  including 
Newton's  method  and  ordinary  differential  eauations  solvers, 
which  seem  to  be  easier  to  implement.  These  methods  are  gen¬ 
erally  known  as  "continuation  method"  . 

The  essence  of  the  "continuation  method"  is  "path  follow¬ 
ing".  The  purpose  of  this  paper  is  to  develop  simple  algo¬ 
rithms  and  flow  charts  so  that  scientists  may  easily  program 
reliable  curve  followers.  The  emphasis  is  on  simpl icity  and 
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rel iabi 1 ity  at  the  expense  of  speed .  We  find  that  simple 
routines  using  variable  step-size  differential  equation  sol¬ 
vers  can  be  made  reliable.  Our  preliminary  experiments  have 
utilized  a  fourth  order  Runge-Kutta  solver  in  which  we  have 
found  it  necessary  in  some  cases  to  vary  raoidly  the  step 
length  over  a  range  of  10 

The  philosophy  of  the  aoproaches  of  Watson  [13],  Smale 
[12]  and  others  may  be  interpreted  as  minimizing  the  impor¬ 
tance  of  accuracy  in  following  the  curve.  In  lectures  Smale 
has  advocated  large  jumps  with  little  concern  for  whether  the 
follower  accidentally  skips  from  one  path  of  zeros  to  another 
nearby  one.  Now,  however,  classes  of  problems  are  coming  to 
light  in  which  it  is  important  to  remain  on  a  simple  curve. 

As  an  example,  consider  the  problem  of  solving  all  the  roots 
of  a  system  of  n  polynomials  in  n  complex  variables  [4] 

[5]  ,  [8]  ,  [9]  ,  by  homotopy  method.  It  is  important  to  note 
that  it  is  necessary  to  follow  a  different  curve  to  obtain 
each  solution.  If  the  paths  are  not  followed  with  care,  solu¬ 
tions  can  be  missed.  The  same  necessity  occurs  with  other 

t 

problems  such  as  the  inverse  eigenvalue  problem  [1]  .  The 
curve  must  be  followed  carefully. 

Paragraphs  2-4  describe  an  algorithm  which  is  summa¬ 
rized  in  the  following  flow  chart  for  following  a  nondegen¬ 
erate  curve  to  a  solution.  The  existence  of  such  curves  is 
"guaranteed  with  probability  one"  in  [3]  .  Nonetheless  §5 
describes  situations  in  which  the  algorithm  may  fail  to  fol¬ 
low  the  curve  to  a  point  desired.  In  §6  numerical  results 
are  described. 

For  convenience,  we  limit  our  discussion  here  to  the 
homotopy  type  algorithms  as  reouired  by  Chow,  Mallet-Paret 
and  Yorke  [3]  ,  Alexander  and  Yorke  [2]  .  To  follow  the  so¬ 
lution  curves  in  the  algorithms  based  on  the  global  Newton 
method  of  Smale  [12]  or  the  non-retraction  method  given  by 
Kellogg,  Li  and  Yorke  [10]  are  ouite  similar  with  some  vari¬ 
ations.  In  all  these  cases  we  follow  a  solution  curve  by 
numerically  integrating  an  initial  value  problem  until  a  point 
of  interest  is  encountered. 


COMMENTS  AND  KI  T  l  N!  MI  NT;' 


1.  Write  V  »  IT  , X  ) 
n  n  n 

|2.  Initialize  T-  »  0 

X .  ®  initial  point 
1  - 1  4 

n  ■  0,  As  .1,  i  »  10  for  an  18  digit  comouter  wid 

length. 

T 

.1 .  K  means  the  T  component  of  the  vector  field,  if 

iJl' 

1'  •  g-  .  F  is  the  unit  vector  along  the  curve. 

4.  At  one  point  we  set  As  -  2 As.  That  is,  ^  *  2As^. 

In  fact  it  is  more  efficient  to  try  to  increase  As  less 
often.  In  general  "equations’'  are  Fortran  statements  " 

5 .  After  computing  AV  ■  H ’  Hh  we  check  |H*Ayj/jh;  which 

.4 

should  be  near  0.  Print  it  out  if  '10 

6.  One  can  check  |Y  1  and  terminate  the  run  if  |Y  |  >  10^4 

n  n 

or  terminate  if  the  number  of  H'  evaluations  exceed  say 
5>00.  Some  ill-posed  homo  too  ies  can  have  trajectories  un¬ 
bounded.  One  should  similarly  check  if  T  ^  < 

7.  Fourth  order  Runga-Kutta  is  used  to  allow  easy  programming 
plus  reliability  tat  the  exoense  of  speed). 

Let  J  »  (0,a)  for  some  a  >  0  and  let 
H  :  [0,1]  *  Rn  ■*  Rn  be  smooth  with  H(0,xq)  *  0  and 
H  ( 1 ,  x )  ■  Ftx)  and  C  :  J  -*■  10,1]  "  Rn  bo  a  smooth  curve  such 
that 

(i)  He’  ( s)  It  »  1  for  s  «  R  (paramet  r  izat  ion  according 
to  arc  length)  where  c'(*)  *  ct*)  and  tl  *11  is 
the  usual  Euclidean  norm. 

(ii)  H(c(s))  ■  0  for  s  «  J 

(iii)  H ' (c (s) )  has  rank  n  for  s  t  J  (where  H'  denotes 

the  Frechet  derivative  of  H  with  respect  to  It.xH 

i.e.  ail  points  on  the  curve  C  are  regular. 

We  suppose  we  have  a  regular  curve,  namely  a  curve  sat¬ 
isfying  condition  (i),  (ii),  (iii).  The  algorithm  is  for 
following  such  a  curve.  Differentiating  (ii)  according  to 
arc  length  gives 

H'(c(i))c'(8)  »  0  for  s  «  R,  and  ^  ^ 

4c'  ( »)  H  ■  1  for  s  c  R 

The  algorithm  requires  that  we  have  given  starting  point 
y  on  the  curve  and  we  set  c(0)  ■  yQ. 
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§2.  Proceeding  along  the  curve 

When  integrating  the  differential  equation  (1.1)  numeri¬ 
cally,  one  inevitably  makes  some  error  which  will  become 
significant  if  one  does  not  wish  to  use  a  small  step  size. 

By  taking  into  account  the  suecial  form  of  our  problem,  it  is 
possible  to  correct  the  integration  procedure.  This  is  done 
by  choosing  a  hyperplane  P  approximately  "Derpendicular "  to 
the  curve  and  calculating  the  locally  unique  Doint  in 
H  A (0)  n  p  by  Newton  method  as  illustrated  in  the  Figure. 


Thus  one  can  consider  the  integration  procedure  as  a 
"predictor  step"  and  the  Newton  method  as  a  "corrector  step". 
Theoretically,  there  exists  an  such  that  if  the  "step 

size"  jump  s  is  less  than  Sq  then  the  Newton  method  will 
always  converge  [14].  In  practice,  we  take  an  initial  jump 
of  length  s.  from  y  reachino  at  a  Doint  z~ ,  which  mav 
or  may  not  be  in  the  convergence  region  of  Newton  method.  In 

our  algorithm,  we  first  make  a  Newton  step  starting  at  7} , 

2  12 
reach  a  point  z  .  We  then  compare  II H  (z  )  II  and  llH(z  )  II  . 

1  2 

If  II  H  (z  )  II  >  1  011  H  (z  )  II  ,  we  then  use  Newton  method  reoeated- 

3  4 

ly  to  generate  z  ,  z  ,  ••*.  Before  using  Newton  method  at 
zn  we  check  to  see  if 

llH(zn~1)ll  >  10  II  H  ( zn)  II  (2.1) 

is  satisfied.  If  (2.1)  is  not  satisfied  we  will  check  to  see 
if  II  A  z^  II  =  II  zn  -  zn_1l|  is  too  small  to  make  a  significant 
improvement  in  H  values  because  the  rounding  off  of  the 
machine . 

Therefore,  let  e  be  the  machine  accuracy.  If 

II A  z  II  <  e  we  set  y  . ,  =  2  and  move  on .  If  II  A  z  II  >  e » 
n  m+l  n  n 

the  initial  step  size  s^  will  be  cut  in  half  and  the  whole 
procedure  is  restarted  with  the  new  step  size.  To  save  the 
number  of  the  Newton  iterations,  the  4t*1-order  Runae-Kutta 


method  is  used  as  a  "pred ictor" .  (It  is  5^^-order  on  each 
step.)  Therefore,  every  time  the  step  size  is  cut  in  half 
the  "predicted”  point  is  expected  to  he  roughly  32  times 
"closer"  to  the  solution  curve  than  it  was  before.  The  num¬ 
ber  of  steps  required  could  clearly  be  reduced  slightly  by 
using  rough  rules  of  thumb  on  how  many  times  to  use  Newton's 
method  before  taking  the  next  step,  but  in  practice  the 
difference  will  be  small  and  such  rules  are  difficult  to 
justify  in  a  general  purpose  algorithm.  On  the  other  hand  if 
a  lower  order  solver  was  used  as  a  predictor,  the  reauired 
number  of  steps  would  increase  immensely  in  some  of  the  pro¬ 
blems  we  have  investigated.  Adams  predictors  are  substan¬ 
tially  more  difficult  to  program  if  the  step  size  is  to  be 
varied  rapidly  as  we  find  necessary.  Standard  Adams  differ¬ 
ential  equations  solver  packages  do  not  permit  one  to  inter¬ 
sperse  Newton  method  correctors  after  each  step,  and  because 
of  slow  start-up  routines  these  packages  are  only  efficient 
when  the  Newton  correctors  are  used  after  many  steps,  but 
then  it  is  necessary  to  take  small  steps  so  that  the  cummula- 
tive  error  remains  small. 

The  solution  would  be  to  make  major  surgical  changes  on 
a  standard  package  and  create  a  new  package.  The  usual  diffi¬ 
culty  with  Runge-Kutta  Schemes  is  that  it  is  difficult  to 
choose  optimal  step  size  is  eliminated  in  our  situation  by  the 
existence  alternative  estimates  on  the  optimality  described 
in  this  section  and  the  next. 

§3.  Angle  checking 

From  (1.1),  c'(s)  is  characterized  by 

H' (c(s)  )c' (s)  =  0  and  II  c 1  (s)  II  =  1  and  c1  changes  contin¬ 
uously.  Since  H*  is  an  n  *  (n+1)  matrix  with  rank  n, 
there  exists  two  vectors,  differing  by  a  factor  of  -1 ,  v 
and  -v,  such  that  H'v  =  -H'v  =  0  and  llvll  =1.  So, 
c'(s)  =  v  or  c'(s)  *  -v.  Choosing  the  wrong  sign,  may  lead 
to  "misorientation"  as  in  the  Figure. 


By  using  the  index  theory,  this  error  can  be  corrected  by 
checking  the  sign  of  the  determinants  of  a  certain  matrix. 
This  method  is  inefficient,  for  the  computation  of  determin¬ 
ants  is  unstable,  expensive  and  generally  unnecessary.  There¬ 
fore,  to  move  along  the  curve  in  a  consistent  way,  we  adopt 
the  following  method. 

Let  y,  ,  be  two  successive  points  on  c(s)  with 

12 

H(c(s))  =  0,  and  v  ,  v  be  the  corresponding  0-vector  of 

H' (y, ) ,  H'(y-)  with  II  v1!!  =  llv2ll  =1.  We  choose  the  sign  of 
2  1  1 

v  to  enforce  the  condition 
1  2 

II  v  -  v  II  <  .  3  or  simply 

(3.1) 

(v1,  v2>  >  .95 

where  <,>  represents  the  usual  inner  product  in  the 
Eucledian  norm.  That  is,  we  reauire  the  angle  between  v^ 

2 

and  v  be  less  than  about  18°.  We  cut  the  step  size  in 
half,  if  necessary,  to  fulfill  the  condition  (3.1).  By  using 
this  angle  checking  routine,  our  algorithm  gives  more  points 
automatically  on  the  curve  when  the  curve  has  a  "sharp"  turn. 
§4.  Speed-up  the  step  size 

In  general,  it  is  preferable  to  let  step  size  adjust 
automatically  according  to  the  smoothness  of  the  curve.  That 
is,  the  big  "jump"  is  taken  when  the  solution  curve  is  "smootH' 
and  small  step  is  used  otherwise.  The  flow  chart  does  this 
by  always  doubling  the  step  size  used  in  taking  the  last  step 
lor  use  as  the  initial  step  size  in  the  present  step.  Thus, 
if  conditions  (2.1),  (3.1)  do  not  provide  any  cut  for  the 
s'rep  size,  it  will  grow  exponentially  after  few  steps.  A 
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more  efficient  procedure  than  doubling  every  tine  is  the 


following.  Let  As  ^  denote  the  step  size  imulemented  in  the 


.  th 
1 

step  i  = 

l 

1 , • • • n .  Choose 

o , 

the  initial  estimate  for 

As  .  •,  ,  as  f  ol  lows  : 
n+1 

1 . 

If  n  =  1 , 

then  set 

a  = 

2As^ 

• 

2. 

If  n  _>  2 

and  As 

n 

=  2  As 

n 

-1' 

then  start  with  o  =  2As 

n 

3. 

If  n  >  3 

and  As 

n 

=  As 

n- 

1 

As  „  then  start  with 
n-2 

o  =  2Asn . 

4  . 

Otherwise , 

we  start 

with 

a  = 

Asn. 

§5. 

Termination 

In  general,  the  path  following  routine  will  eventually 

carry  the  path  to  or  Dass  through  the  region 

R  =  {  (T,x)  |  (1-T)  <  e}  where  e  is  some  constant,  usually 

chooscn  to  be  the  estimated  comDutat ional  accuracy.  We 

terminate  the  algorithm  with  (T  . ,  x  .  )  lies  in  R.  If 

J  n+1  n+1 

T  ,  .  >  1  and  (1-T  . ,)  >  e  we  interpolate  T  as  a  function 
n+1  n+1 

of  s  to  find  new  step  size  As  which  gives  aDoroximately 

T  , .  5  1 .  Our  experience  shows  that  the  cuadratic  interoola- 
n+1  dT, 


tion  usina 


n 


n+1 


and 


T  1 

"n+1 


ds 


is  far  more  effi- 


n+1 


cient  then  simoler  linear  interoolation  on  T 


and 


n  ”  'n+1' 

This  should  not  be  confused  with  ouadratic  interoolation 


using 


T  ,  ,  T  , 
n-1  n 


and 


T  ,  which  may  be  auite  bad. 
n+1  1 


§6.  Remarks 

The  flow  chart  shown  in  §1  gives  a  general  framework 
for  the  algorithm.  Homotopy  theory  has  given  many  situations 
in  which  the  curve  is  guaranteed  to  end  at  T  =  1.  The 
algorithm  may  fail  to  follow  such  a  curve  to  t  =  1  for  some 
rather  sinaular  situations.  Althouqh  it  is  not  listed  in  the 
Flow  Chart,  a  Droaram  may  wisely  be  designed  to  test  for  the 
following : 

1.  The  rank  of  H’  may  become  "nearly"  less  than  n.  In 
practice,  it  is  impossible  to  demonstrate  the  rank  is  less 
than  n,  but  certainly  one  might  encounter  a  matrix 
(when  following  path)  whose  rank  "aDpears"  less  than  n. 
If  we  approach  such  a  singular  situation  then  the  step 
size  may  become  very  small.  A  new  choice  of  initial  con¬ 
stants  may  remedy  this  situation,  though  such  an  occur¬ 
rence  suggests  the  Droblem  has  not  been  posed  correctly. 

2.  c(s)  may  become  unbounded. 

This  is  another  type  of  difficulty  that  can  occur  if  the 
homotopy  is  not  in  some  sense  well  posed.  The  homotopy 
method  can  be  used  when  one  has  no  guarantee  that  path 
will  continue  to  t  =  1  when  one  is  uncertain  whether 
the  path  is  advisible.  Similarly,  there  is  a  third 
possibility. 

3.  A  path  may  return  to  t  =  0. 

If  no  check  is  made  for  such  a  possibility,  considerable 
computation  time  may  be  wasted  as  the  path  wandering 
around  in  the  region  where  t  <  0. 
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Alden  Wright , (Western  Michigan  University),  has  suggested 
(personal  communication)  that  when  faced  with  the  possibility 
of  |c(s)  it  may  sometimes  be  wise  to  rescale,  and 

using  new  variables  (1,  x2/x1,***,x  /x^  and  £n | x^ |  and 
x^/|x^|.  He  particularly  recommends  this  change  when  dealing 
with  systems  of  polynomial  eauations  where  the  variables  x. 
are  complex. 

As  we  mention  in  the  introduction,  the  emphasis  on  the 
Flow  Chart  is  the  "simplicity".  The  numerical  results  in  the 
next  section  indicate  that  we  can  rely  on  this  algorithm  to 
carry  the  path  to  some  t  which  is  arbitrarily  close  to  1, 
as  long  as  the  machine  precision  permits.  One  may,  of  course, 
set  t  =  1  and  switch  to  Newton  method  far  before  t  reaches 
| t— 1 |  <  e,  where  e  is  the  machine  accuracy.  The  best 
strategy  seems  to  be  the  following:  Use  Moore's  Algorithm 
[15]  on  (Tn,xn)  if  Tn  is  bigger  than  some  value,  say  .9, 
to  check  if  the  Newton  iteration  on  F(x)  =  0  will  converge 
by  using  xn  as  starting  point.  We  switch  to  Newton  itera¬ 
tion  if  Moore's  Algorithm  indicates  the  convergence  of 
Newton  iteration.  If  Moore's  Algorithm  fail's  to  guarantee 
the  convergence  of  Newton  iteration,  we  use  the  path  follow¬ 
ing  routine  to  push  t  one  step  further  toward  t  =  1  and 
repeat  the  procedure.  The  implementation  of  this  strategy 
is  beyond  the  scope  of  the  paper. 

§7.  Numerical  results 

A  series  of  computer  exneriments  were  made,  implementing 
the  path  following  algorithm  described  in  §2-4,  for  find¬ 
ing  all  the  roots  of  polynomials  of  one  complex  variable. 

The  first  example  is  the  Wilkinson  polynomial  [15]  of  degree 
20.  That  is, 

p(z)  =  (z+1)  (z+2)  •  •  •  •  (z+20)  +  z^2~^ 

To  solve  p(z)  =  0,  we  write 

H  (z ,  t)  =  (1— t)k(z— ax)  •••  (z— an)  +  (1- (1-t) k) p (z) 

where  a^  e  c  for  all  1  <  i  <  n.  It  can  be  shown  that  for 

almost  all  a  =  (a  •••a  )  e  cn,  H_1(0)  consists  of  n  smooth 

l  n 

paths  all  of  them  are  bounded  and  connected  to  t  =  1.  So, 

we  choose  (a, ,••• ,a  )  «  cn  "at  random",  and  follow  each  path 
1  n  —12 

individually  to  | t-1 |  <  s  with  e  =  10  and  k  =  4. 
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(The  computations  are  done  on  Univae  ilOO  with  complex  double 
precision.)  The  results  are  shown  on  Table  1.  As  one  can 

easily  see  that  no  root  is  missed  and  *.  he  stop  sizes  varied 

_  8 

from  10  to  6.4.  H(T  ,x  )  is  sometimes  as  biq  as 
20  n  n 

10  for  points  c  away  from  the  curve,  but  this  causes  no 
difficulty.  We  evaluate  the  polynomial  as  a  product  of  20 
terms,  thereby  avoidinq  one  of  the  difficulties  of  roundoff 
error  that  Wilkinson  emphasized.  Nonetheless  the  polynomial 
is  quite  sensitive  in  the  sense  that  the  paths  must  be  fol¬ 
lowed  ouite  closely  if  they  are  qoinq  to  be  followed  reliably. 

The  second  example  is  the  polynomials  with  multiple 
roots.  Let 

Pq  ( z )  =  (x+1)3 

and 

H0(t,z)  =  (l-t)k(z-a1)  (z-a2)  (z-a3)  +  (1- (1-t) k) PQ  (z)  . 

Table  2  shows  that  Pg(z)  does  not  cause  difficulty  on 
our  algorithm. 

To  demonstrate  the  stability  of  our  alqorithm,  we  write 
Pc  (z)  =  (x+1)  (x+1  +  c)  (x+1  -  c) 

and 

Hc(z)  =  (l-t)k(z-ai) (z-a2) (z-a3)  +  (1- (1-t) k) Pf (z)  . 

Tables  3,  4,  5,  6  show  the  computation  results  for  e  =  10  \ 
-2  -3  -5 

10  ,  10  and  10  .  Once  again,  it  is  shown  that  no  roots 

are  missed.  We  also  show  on  Tables  8,  9,  10,  11  that  the  al¬ 
gorithm  without  angle  checking  is  eoually  reliable  in  cases 
that  solution  path  are  "rather"  smooth.  While  we  are  finding 
roots  of  a  polynomial  that  has  only  real  roots,  an  additional 
difficulty  would  occur  if  the  roots  were  triple  (or  nearly 
triple)  non-real  roots  since  our  algorithm  then  does  not 
handle  real  roots  in  any  special  way. 
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Continuation  versus  Newton  Methods 

We  have  chosen  to  find  roots  of  polynomials  for  this 
paper  because  polynomial  root  determination  yields  and  inter¬ 
esting  set  of  highly  nonlinear  test  problems.  We  make  no 
claim  that  continuation  is  an  efficient  way  of  finding  roc  s 
of  polynomials.  We  do  not  make  use  of  the  suecial  "field" 
properties  and  in  particular,  after  we  find  one  root,  we  do 
not  in  any  sense  divide  it  out  or  even  take  it  into  consid 
eration  in  any  way  for  finding  the  other  roots.  We  do  not 
make  any  special  search  for  real  roots,  (and  having  the  root  .* 
real  is  not  even  a  hole)  .  These  practices  make  polynomials, 
a  reasonable  set  of  test  problems  since  in  most  nonlinear 
problems,  such  as  finding  roots  of  systems  of  polynomials  or 
for  inverse  eigenvalue  problems,  special  technioues  are  not 
available.  The  existence  of  several  roots  in  our  problems 
allow  us  to  test  here  whether  we  actually  follow  different 
paths  correctly. 

Given  our  practices  we  asked  how  Newton's  method  would 
compare.  For  the  Wilkinson  polynomial 

n  (x  +  k)  +  2  xiy 
k=l 


we  chose  several  roots.  For  each  root 
starting  point  of  the  form 

Xq  =  xQ  +  t ( 1+i) 

By  experimenting  with  several  values  of 


Xq,  we  chose  a 


t,  we  determined 


how  far  from  the  root  the  initial  point  could  be  and 

still  have  Newton's  method  give  a  sequence  converging  to  the 
root  xQ.  Wc  chose  the  direction  1+i  in  defining  x^  as 
a  reasonable  representative  direction;  given  a  starting  point 
Xq,  the  closest  root  x^  might  be  any  direction  form  . 

To  use  Newton’s  method  to  find  the  foots,  starting  points 
could  be  selected  at  random,  and  we  test  in  essence  how  close 
the  starting  point  must  be  and  still  get  convergence  to  that 
root . 
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Newton's  Method 
x  Converges  for 

0  t  = 


Newton's  Method 
Does  Not  Converge 
t  = 


-16.71-t2.81i 
-16.71-2.81i 
-19. 50+ 1 . 94  i 
-19.50-1 .94i 


.3 

.2 

.3 

.2 

Table  11. 


.4 

.3 

.4 

.3 


Table  11  shows  that  for  some  of  the  roots  Newton's 
method  is  successful  only  when  x^  is  auite  close.  Even 
when  Xq  is  closer  to  x|j  than  any  other  toot,  by  a  factor 
of  7,  (as  is  the  case  of  the  entries  in  Table  10)  Newton's 
method  may  fail  to  converge  to  x^. 

Often  one  is  interested  in  finding  only  one  root,  but 
the  calculations  in  Table  10  suggest  the  nature  of  Newton's 
method:  local  converge.  When  starting  outside  some  ill- 

defined  boundary,  Newton's  method  will  often  produce  a 
sequence  which  diverges.  More  work  is  needed  to  demonstrate 
in  much  greater  detail  the  inadecruacy  of  Newton's  Method  on 
a  variety  of  problems  when  compared  with  continuation  and/or 
simplicial  methods. 
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